® Vision System Measures Motions of Robot and External Objects 

Frame rates greatly exceed those of prior systems. 

N ASA's Jet Propulsion Laboratory, Pasadena, California 


A prototype of an advanced robotic vi- 
sion system both (1) measures its own 
motion with respect to a stationary back- 
ground and (2) detects other moving 
objects and estimates their motions, all 
by use of visual cues. Like some prior ro- 
botic and other optoelectronic vision 
systems, this system is based partly on 
concepts of optical flow and visual 
odometry. Whereas prior optoelectronic 
visual-odometry systems have been lim- 
ited to frame ratesof no more than 1 Hz, 
a visual-odometry subsystem that is part 
of this system operates at a frame rate of 
60 to 200 Hz, given optical-flow esti- 
mates. The overall system operates at an 
effective frame rate of 12 H z. M oreover, 
unlike prior machine-vision systems for 
detecting motions of external objects, 
this system need not remain stationary: 
it can detect such motions while it is 
moving (even vibrating). 

The system includesa stereoscopic pair 
of cameras mounted on a moving robot. 
The outputs of the cameras are digitized, 
then processed to extract positions and 
velocities. The initial image-data-process- 
ing functions of this system are the same 
as those of some prior systems: Stere- 
oscopy is used to compute three-dimen- 
sional (3D) positions for all pixels in the 
camera images. For each pixel of each 
image, optical flow between successive 
image frames is used to compute the two- 


dimensional (2D) apparent relative trans- 
lational motion of the point transverse to 
the line of sight of the camera. 

The challenge in designing this sys- 
tem was to provide for utilization of the 
3D information from stereoscopy in con- 
junction with the 2D information from 
optical flow to distinguish between mo- 
tion of the camera pair and motions of 
external objects, compute the motion of 
the camera pair in all six degrees of 
translational and rotational freedom, 
and robustly estimate the motions of ex- 
ternal objects, all in real time. To meet 
this challenge, the system is designed to 
perform the following image-data-pro- 
cessing functions: 

The visual-odometry subsystem (the 
subsystem that estimates the motion of 
the camera pair relative to the stationary 
background) utilizesthe 3D information 
from stereoscopy and the 2D informa- 
tion from optical flow. It computes the 
relationship between the 3D and 2D mo- 
tionsand usesa least-mean-squares tech- 
nique to estimate motion parameters. 
The least-mean-squares technique is 
suitable for real-time implementation 
when the number of external-moving- 
object pixels is smaller than the number 
of stationary-background pixels. 

In another subsystem, pixels represen- 
tative of external transversely moving ob- 
jects are detected by means of differ- 


ences between (1) apparent transverse 
velocities computed from optical flow 
and (2) the corresponding relative 
transverse velocities estimated from vi- 
sual odometry under the temporary as- 
sumption that all pixels belong to the 
stationary background. 

In yet another subsystem, pixels repre- 
sentative of radially moving objects are 
detected by means of differences be- 
tween (1) changesin radial distance esti- 
mated from changesin stereoscopic dis- 
parities between successive image frames 
and (2) the corresponding relative ra- 
dial velocities estimated from visual 
odometry under the temporary assump- 
tion that all pixels belong to the station- 
ary background. H owever, it is more dif- 
ficult to detect radial than to detect 
transverse motion, especially at large dis- 
tances. This difficulty is addressed by in- 
corporating several additional process- 
ing features, including means to 
estimate ratesof change of stereoscopic 
disparities, post-processing to prevent 
false alarms at low signal-to-noise ratios, 
and taking advantage of sometimes 
being able to distinguish between radial- 
motion optical flow and transverse-mo- 
tion optical flow at short distances. 

This work was doneby AshitTalukder and 
Larry M atthies of Caltech for NASA's Jet 
Propulsion Laboratory. Further information is 
contained in aTSP (see page 1). NPO -40687 


3 Advanced Precipitation Radar Antenna To Measure Rainfall 
From Space 

This parabolic cylindrical reflector uses Ku and Ka bands. 

N A SA'sJdt Propulsion Laboratory, Pasadena, California 


To support NASA's planned 20-year 
mission to provide sustained global pre- 
cipitation measurement (EOS-9 Global 
Precipitation Measurement (GPM )), a 
deployable antenna has been explored 
with an inflatable thin-membrane struc- 
ture. This design uses a 5.3x5.3-m inflat- 
able parabolic reflector with the electron- 
ically scanned, dual-frequency phased 
array feeds to provide improved rainfall 
measurements at 2.0-km horizontal reso- 
lution over a cross-track scan range of up 
to £37 2 , necessary for resolving intense, 


isolated storm cells and for reducing the 
beam-filling and spatial sampling errors. 
The two matched radar beams at the two 
frequencies (Ku and Ka bands) will allow 
unambiguous retrieval of the parameters 
in raindrop size distribution. 

The antenna is inflatable, using 
rigidizable booms, deployable chain- 
link supports with prescribed curva- 
tures, a smooth, thin-membrane reflect- 
ing surface, and an offset feed 
technique to achieve the precision sur- 
face tolerance (0.2 mm RM S) for meet- 


ing the low-sidelobe requirement. The 
cylindrical parabolic offset-feed reflec- 
tor augmented with two linear phased 
array feeds achieves dual-frequency 
shared-aperture with wide-angle beam 
scanning and very low sidelobe level of 
-30 dB. Very long Ku and Ka band mi- 
crostrip feed arrays incorporating a 
combination of parallel and series 
power divider lines with cosine-over- 
pedestal distribution also augment the 
sidelobe level and beam scan. This de- 
sign reduces antenna mass and launch 
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